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PREFACE 



This IS a report on the work done by the General Electric Company 
—TEMPO under contracts HEW-05-67-55 (A Survey and Preliminary 
Cost-Benefit Analysis in. Elementary and Secondary Education) and 
OEC-D-8-08042-3513 (Analyses of Compensatory Education within 
Schools from Five Major School Districts). Detailed findings of the 
first study are described in an earlier TEMPO report. Survey and 
Analysis of Results from Title I for Compensatory Education. 1 March 
19b8, available through the U. S. Department of Health, Education, 
and Welfare, Office of Education. 



Volume I of this report summarizes the results of both research 
efforts. Sections 1, 2, and 3 of Volume I, which describe the over- 
all Phase II effort, were prepared by E. J. Mosbaek of TEMPO. Sec- 
tion 4 of Volume I is a synopsis of the Phase I effort. Most of this 
section was written by Bayla White of DHEW. The basic data for the 
study were collected by joint teams of DHEW, OE, and TEMPO per- 
sonnel. Some of these data appear in Section 5 of Volume I. 

Volume II gives the detailed results from the case study of each 
of the five Bchooi districts included in the Phase II effort and des- 
cribes the technical features of the methodologv used. Volume II 
was prepared by F. R. Frola, K. F. Gordon, J.'w. Harrison, and 
E. J* Mosbaek, all of whom are TEMPO staff members. 

The effort and critical comments from personnel in local districts 
well as personnel from DHEW and OE were crucial in carrying out 
this research. It has been agreed that none of the sample schools or 
school districts will be identified in the results reported. 
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SECTION I 
SUMMARY 



OBJECTIVES 

The objectives of this study, which is the second phase of an analy- 
sis of the results of the U. S. Office of Education's Title I funding pro- 
gram for compensatory education, were to develop preliminary an- 
swers to the following questions: 

1. Is the evidence of statistically significant enhancement from 
compensatory education (CE) stronger, and the estimates of 
magnitude greater, when adjustments are made for possible 
trends in achievement? 

2. What are the distinguishing features of successful CE pro- 
grams? 

3. What school, pupil, and environmental characteristics are 
associated with enhanced pupil performance? 

In carrying o*ut these objettives TEMPO collected and sumniJtrized 
considerable information on allocation of CS funds as well as informa- 
tion on type and intensity of different CE activities. 

SAMPLE CHARACTERISTICS 

The analysis involved characteristics of CE activities plus the 
characteristics and reading achievement level of 6, 500 pupils in 00 
Title I schools in five school districts. These five school districts 
were a subsample of the 11 school districts included in an earlier 
(Phase I) TEMPO study.* Since the five districts were selected on 
the basis of available data they do not constitute a random subsample, 
and thus summary statistics from the two studies agree leas than they 
otherwise might. For example, in the earlier study there was a 



^Described in Section 4. 
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statistically significant positive change in the lowest decile for the 
entire sample, whereas the change in the lowest decile in this study 
is not statistically significant. 

ANALYTICAL APPROACHES 

Two analytical approaches were used, a ''fixed-grade*' approach 
and a "longitudinal" approach. The approach to achievement analysis 
of 1, 200 pupils from District 8 was longitudinal, i.e. , to compare * 
achievement for the same pupil both before and after exposure to 
specific CE programs. The approach in the analysis of the 5, 300 
pupils in the othep four districts was to compare achievement of two 
successive groups of pupils in the same grade in a school. The first 
group was pupils tested in 1965-66 when there was little or no expos- 
ure to CE, and the second group was pupils tested in 1966-67 or 
1967-68 after CE from Title I had been implemented. 



CHANGES IN ACHIEVEMENT 

It was not possible to make reliable adjustments for possible trends 
in achievement in Title I schools. However, the more detailed analy- 
ses in this Phase Ii study permit a different focus on the type and 
amount of enhancement from CE than was available from the earlier 
study. 

Title I funds have significantly increased the amount of CE in all 
five school districts. It appears that the increased CE has, in turn, 
led to significant improvement in the achievement level for some 
pupils. The degree of success appears to vary widely among CE 
activities even within the same district. 

For 790 pupils in a CE reading program in District 8, the rate of 
increase in achievement during th\3 3-month CE program was twice 
as great as might have bcfen expected in the absence of CE. The ex- 
pected increase in grade level for these pupils was 0. 7 of a year per 
year, and the actual increase with CE was 1.4 years per year. In 
District 13, the average increase in achievement for all pupils in 
sample schools was approximately 1 month greater than would be ex- 
pected in the absence of CE. 

RESULTS VARY WIDELY 

Other results obtained during this study are not as encouraging 
with respect to enhancement from CE as those indicated above. A 
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second major CE activity in District 8 sho'sved no eviderAce of success 
even though CE expenditures per pupil were greater than for the ac- 
tivity which doubled the rate of increase in achievement. 'Results for 
Districts 10 and 12 show no significant change in achievement during 
the periods analyzed. In District 14, there is evidence that the aver- 
age achievement of the lov^est 10 percent of pupils in Title I schools 
actually decreased during 1966-67, even though there was an average 
increment of $80 per pupil for CE. 

1 

SPECIFIC DATA NEEDED 

We suggest that the striking results within District 8 reflect, in 
part, the better data that were available rather than the possibility 
that other sample districts did not have as good CE activities as this 
district. In the Phase I study, data on specific pupils were not avail- 
able, and the general conclusion from summary statistics on all pupils 
in Title I schools in District 8 was that changes were not statistically 
significant. This points up the need for more complete strati sties con- 
cerning CE programs. 

It was not possible to develop definitive answers to the questions 
concerning distinguishing features of successful CE and pupil- school- 
environmental characteristics asspeiated vnth enhanced pupil perform- 
ance. However, several important hypotheses and insights were de- 
veloped. These are presented in the discussion of each district in 
Appendices 1 through 5 pnd are summarized in Section 3. There 
were few data for testing hypotheses because of the great diversity 
in types of CE and target groups of pupils. 

WIDE DISPERSION OF CE FUNDS 

By and large, local school officials have allocated CE funds over 
a wide range of activities and have oriented them to a large popula- 
tion of pupils. There is a general tendency to allocate, say, 20 per- 
cent of Title I funds to a very small n\imber of pupils and to allocate 
the other 80 percent over such a large number of pupils that in most 
cases the funds amount to less than $5 per pupil. 

PRESSING QUESTIONS 

It is possible that a more intense concentration of funds on certain 
programs and jpupil categories might have resulted in more signifi- 
cant improvements in reading achievement level. However, the need 
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for CE far exceeds the availability of Title I and local funds. This 
iininediately raises the followingf questions for local school officials! 

• What should be the priorities among many alternative end 
objectives, e. g. , equal amounts for all pupils or concen- 
tration on the few most needy pupils? 

• What achievement results can be expected for a specified 
CE activity for a given target group of pupils? 

• What are the true total cost and the most efficient way of 
implementing a specified CE activity for a given category 
of disadvantaged pupils? 

Each of these questions must be addressed before the policy of wide 
dispersion of CE funds can be criticized meaningfully. 
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SECTION 2 

STUDY OBJECTIVES AND METHODOLOGY 



The objectives of this study, which is the second phase of an analy- 
sis of the results of the Title I funding program for compensatory 
education, were to develop preliminary answers to the following ques- 
tions: 



1. Is the evidence of statistically significant enhancement from 
compensatory education (CE) stronger, and the estimates of the 
magnitude greater, when adjustments are made for possible 
trends in achievement? 

2. What are the distinguishing features of successful CE pro- 
grams? 

3. What school, pupil, and environmental characteristics are 
associated with enhanced pupil performance? 

These questions differ primarily from those addressed in the Phase I 
study in that they reflect a more intensive effort to determine whether 
trends in achievement levels were present in the samples examined. 
The presence of such trends might dictate adjustments in study re- 
sults and allow more definitive answers to all three questions. 

To accomplish the Phase II objectives, TEMPO collected and ana- 
lyzed data at the grade level within each sample school in five of the 
11 school districts previously analyzed in the Phase I study. These 
data included type and amount of CE, teacher salaries for regular 
programs, pupil- school- environment characteristics, and achieve- 
ment scores. The analysis was based on the fixed-grade approach 
in Districts 10, 12, 13, and 14 and on the longitudinal approach in 
Districts.* 

This research effort was, in essence, a more detailed analysis of 
the data collected during the Phase I effort from March through 

♦See Appendix 6, Volume II, for definitions of the fixed-grade and 
longitudinal approaches. 
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December 1967. The cost data were refined; questions about achieve 
ment data were resolved; and in Districts 10, 12, and 14 additional 
achievement data were obtained in order to derive more definitive 
answers on questions concerning change in achievement. 

In view of the results for the fixed-grade approach in Phase I and 
the results from the fixed-grade approach for four districts in Phase 
II, the opportunity to employ the longitudinal approach in District 8 
seemed significant. Consequently, the analytical approach for this ‘ 
district was changed slightly to provide insight into the advantages of 
analyzing available longitudinal data. 

All analyses were oriented toward determining the effects of CE 
activities regardless of whether or not they were funded by the 
Title I program. In Districts 8, 10, and 13 pre and post refer to 
academic years 1965-66 and 1966-67, respectively. In Districts 12 
and 14, two sets of comparisons were made — one with 1965-66 as 
pre and 1966-67 as post and another with 1966-67 as pre and 1967-68 
as post. Since the CE activities were measured explicitly (dollar per 
pupil), it was not necessary that the "pre" pupils have a zero expo- 
sure to CE in order to evaluate the effect of CE activities conducted 
between the pretest and posttest. 

The level of expenditures for the regular program, i. e. , non-CE 
educational activities, was explicitly identified and brought into the 
analysis for two reasons. First, there is such a large sampling 
variation in achievement results that it is important (if possible) to 
identify specific sources so that variation caused by them can be con- 
trolled or removed. It was assumed that changes in the quality of 
instruction would be the largest source of variation and it was felt 
that level of expenditures per pupil could be used as a proxy variable 
for quality of instruction. Second, it was desirable to determine 
whether levels of expenditures for regular school programs were 
affected by the availability of Title I funds. 

It was realized that differences in the average achievement level 
for two groups of pupils in, say, grade 6 in a school in two different 
years is affected by the quality of education in grades kindergarten 
through 6 for each group. However, it was not feasible to obtain ex- 
penditure data for all prior years. Consequently, expenditure data 
for tho set of pre pupils and the set of post pupils were limited to ex- 
penditures incurred during the 12 months preceding the respective 
test dates, as shown in Figure 1. 
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' Figure 1 « Determining expenditures for pupils in pregroup and poStgroup for 
Grade 6 with test dotes os shown* 

The estimate of expenditures f0^r regiu.*Jt programs was limited 
to salaries of regular classroom teachers on the assumption that 
Trariation in quality of education between two consecutive years would 
mainly be limited to changes in instructor personnel among all com- 
ponents of expenditures. This is also the largest component of ex- 
penditures. Although limiting the measure of regular expenditure 
to classroom teachers and limiting the period to one year do«s not 
enable us to reduce sampling variation caused by differences in qual- 
ity of instruction fully, it does not introduce any bias into the analy- 
8 • 

*■ , •» 

Most of the analysis of achievement in the fixed-grade approach 
in the four districts was carried out in terms of Standard T- scores. 
This enabled us to combine the results for different grade levels. 
However, in the analysis of trend and in the longitudinal analysis of 
District 8, grade -equivalent scores were generally used. Grade- 
equivalent scores have an advantage over Standard T- scores in that 
the unit of measurement is in familiar terms, and the significance in 
terms of achievement level can be readily determined. Whenever 
Standard T- scores were used, the summary results were translated 
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into grade-equivalent scores to reflect the educational significance 
as well as the statistical significance of the estimates. Discussion 
of conversion techniques and tables for converting from one type of 
score to'another are presented in detail in Reference 43, 

In the fixed-grade approach the so-called control group for evalu- 
ating the effect of CE is the pupils in the pre year. In the longitudinal 
approach several different means were used to select a control group 
(or reference point) for judging the net effect of CE. Since these 
techniques are applicable only to District 8, they are explained along 
with the results for District 8 in Appendix 5. However, there is one 
feature that comes to light more in longitudinal analysis but is appli- 
cable to both approaches: the selection of a measure of acMevement 
for evaluating CE. Alternative measures for comparison, as indica- 
ted in Figure 2, include: 

1, Slope from a to b compared to slope of 1. 0 for norm achiev- 
ing pupil, 

2, Achievement level after exposure to CE (b) compared to 
, . , norm achievement level (d), 

3, Achievement level after exposure to CE (b) compared to an 
estimate of the potential level of pupil involved, 



r* 4,- Measurement of the difference between the observed value 
V i: i. fqf m ^wd the estimated value of (c) i. e. , estimated achieve 
.. . .( 1 , ^xiient vdthout CE. 



.In order to avoid measuring progress of pupils enrolled in CE activi- 
ties in terms of the so-called norm-achieving pupil, TEMPO chose to 
nse the fourth measure in this study. 



The formal statistical procedures used^'- included computation of 
.mea^S, standard deviations, simple correlation coefficients, regres 
. ..eion -coefficients, tests. 



^'•■Thd more detailed technique? are described in Appendix 6, 
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SECTION 3 

CONCLUSIONS FROM THE FIVE CASE STUDIES 



INTRODUCTION 

Available data on pupils and compensatory education (CE) activi- 
ties within each of the five districts were analyzed in an attempt to 
anBWer the three major questions addressed by Phase II of the study. 
This section summarizes and integrates conclusions resulting from 
analyses of each district with respect to these three questions and 
discusses other findings that are of general interest in evaluation of 
CE, : 

Evidence on possible negative trends in achievement for schools 
within; the Title I program is presented in the following ’‘Analysis of 
Trendj " This evidence is drawn from trend data for specific schools 
presented in the case study of each school district in Appendices 1 
through 5, Volume II. 

Distinguishing features of successful CE are presented in the third 
subsection. In addition there is a summary of the new evidence on 
type and amount of enhancement from overall CE activities. 

Pupil-school-environmental factors that are associated with suc- 
cess from CE are discussed in the fourth subsection. These factors 
are commonly referred to as state variables because they are the 
given conditions in which CE is implemented. 

In addition to results directly applicable to the three main ques- 
tions addressed by the study, the allocation of CE funds and differ- 
ences in * mount of exposure to CE are summarized in the fifth and 
sixth subsections. New insights into differences between the fixed- 
grade and longitudinal approaches are presented in the last subsec- 
tion. 

ANALYSIS OF TREND 

TEMPO’S hypothesis c? how a trend factor would affect achieve- 
ment scores in successive years is shown in Figure 3. The trend 
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Figure 3. Hypofhesis of fhe effecf of a negctlve frervdi. 



factori i£ any, is probably amall as shown by the croteness o£ the 
lower two lines and is postulated to affect the slope of the progress 
curve as shown by the divergence of the lines, rather than being a 
systematic shift over the entire range of grades 1 through IE. 

Various reasons have been specified for expecting a negative trend 
in achievement within inner-city schools. Th® tendency in the last 
several years has been for families with low income and limited edu- 
cation to move to inner-city areas and for families with higher in- 
come and better education to move from ihe city to the suburbs. 

This can be expected to change the average achievement level of the 
population in the inner-city area. In addition, the expanding population 
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and expanding tax base in suburbs have allowed newer and better edu- 
cational facilities and perhaps better qualified teachers than in the 
inner-city areas. 

The data in this study do not present a consistent picture on trend. 
The pattern of variation during the years for which data are available 
indicates that sampling variation from year to year is much larger 
than any trend factor that might be operating at the school level. 

The fact that significant trends did not show up in the 60 sample 
schools in five school districts is important. A negative trend was 
expected based on the results in the Phase I study and the socioecon- 
omic trends described above. The data analyzied in the more detailed 
Phase II study do not confirm the expectation. This means that there 
is no trend within inner-city schools, or that it is erratic and small. 
The average among seven schools in District 14 showed a slightly up- 
ward trend for the period 1964-68. The average am jng seven schools 
in District 13 showed a negative trend. The averages at different^ 
grade levels in District 8 showed an inconsistent pattern. 

No adjustments were made for trend in any of the school districts. 
Although data for District 13 showed a consistent pattern, the per- 
sonnel in District 13 highly discouraged making any adjustment for 
trend. 

TffiMPO •niieats that the hypothesis of a negative trend is worth 
additional testing* However, this will have to be carried out with 
considerably more data than are available from this study. Further 
study should involve several grades in each sample school, and the 
number of schools should be large in order to control sampling vari- 
ation and detect what is likely to be a small trend factor if indeed it 
exists at all. 

DISTINGUISHING FEATURES OF SUCCESSFUL CE 

Table 1 summarizes the net change in achievement for longitudinal 
data in District 8 and the combined data from the fixed- grade approach 
in the other four districts. As stated elsewhere, however, the em« 
phesis in this study has been placed on analysis within each of the five 
d 5 l/it?'' 0 ts and not on the combined results for all districts. ♦ 

*Di'ff e r enc e s " in re suit s shown in Table 1 and Table 6 of TEMPO* s 
Phase I report (Reference 43) are of little significance because the 
sample of 11 school districts analyzed in the Phase 1 effort was not 
selected on a random basis, and the second selection of five of the 11 
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The average change in achievement for the combined results in 
four districts is positive for all four measures. None of the four, 
however, is significant at the 10 percent confidence level . One of 
the two major CE activities in District 8 (reading improvement) ap- 
pears to have been highly successful. The best estinriate of the net 
effect of CE was large—0. 7 grade equivalent units per year— and the 
estimate appears to be statistically significant. There is no signifi- 
cant change in achievement that can be associated with the second 
major CE activity in District 8. ' 



CE activities oriented specifically toward improvement in reading 
were the most successful.* This is evident from comparison of the 
reading program with the other major activity in District 8 and a 
comparison of the grades in Districts IE and 13 which had significant 
reading CE activity with grades which had less reading but more of 
other types of CE activities. 

The success of the Reading Improvement CE Activity in District 8 
is shown in Figure 4. The lower solid line indicates the expected rate 
of improvement of these pupils in the absence of CE. Each dotted line 
shows the average rate of improvement for a specific grade level 
during the period in which the pupils were enrolled in the reading 
improvement CE. All of the rates were greater than 0. 65, which is 
the estimate of rate of improvement in the absence of CE. The rates 
for all but grade 6 were greater than 1. 0, which is the average rate 
for the norm-achieving pupil. 

The estimate of a 0. 65 rate of improvement in the absence of CE 
for pupils of the type selected in District 8 for reading CE appears 
to be reliable. Data for approximately 500 pupils in each of two 
years was used in establishing the estimate. The estimate was de- 
rived from regression analysis of achievement level of pupil s'^rior 
to enrollment in the reading CE. Details are explained in Section F, 
Appendix 5, 

There is no evidence that the general policy of allocating CE funds 
to a large number of CE activities and to a large number of pupils 



(continued) districts for the present effort was based on availability 
of data rather than on a random subsample. Thus, neither table is 
representative of the total Title X program results. 

♦Reading achievement level was the only measure of accomplishment 
used in this study. 
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Figure 4. Rate of increase in achievemenf level for pupils in reading 
improvement CE, 1966-67— District 8. 

has any significant impact. Each school district had a large number 
of CE activities that affect virtually all of the pupils in Title I schools, 
but these usually amounted to an expenditure of less than $5 per pupil. 
If this wide dispersal of funds were successful, it should be reflected 
in an increase in the average achievement level for all pupils in Title 
I schools. This is not supported by the figures in the upper part of 
Table 1. 

The following distinguishing features of CE activities are impor- 
tant in the design of a CE program: 

1. Teacher aides versus regular teachers. 
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2. Activities oriented toward improving teachers versus ac- 
tivities oriented toward pupils, 

3. Buildings and equipment versus more personnel, 

4. Combination of pupil-oriented activities (e. g. , academic, 
cultural, and health) versus academic-only oriented activities, 

5. More counseling and testing for pupils versus more instruc- 
tion. 

Each type within each of the above alternatives was implemented in 
one or more grades in the sample school districts, but either data 
were too few or simultaneous variation in other factors prevented a 
reliable estimate of the effect of each type. 

An attempt was made in the regression and correlation analysis to 
determine whether change in achievement was closely related to level 
of expenditure for CE activities and for regular classroom teachers, 
but, not surpri singly » the estimates of regression and correlation 
coefficients produced inconclusive results. First, there were only 
small amounts of CE expenditures in rhany cases. , For example, in 
nine of the 22 observations in District 10, the CE expenditures were 
recorded as zero. Second, with respect to regular classroom ex- 
penditures^ the achievement level of a pupil is affected by his educa- 
tion in all pre'</ious years, whereas the study data reflect expenditures 
for only the 12-month period preceding the test data. The "regular 
expenditures" variable was introduced to reduce sampling error in 
measuring the effects of CE; it was not included for the explicit pur- 
pose of measuring returns to scale from educational resources. 

Although the results for District 8 show that the activity with a 
$180-per-pupil expenditure was more successful than the activity 
with $316, this probably reflects the difference in type of CE rather 
than difference in level of expenditure. The difference in results of 
the most successful CE for two different years does suggest a hypoth- 
esis well worth testing. This hypothesis is that the same reading im- 
provement activity when conducted every other day is nearly as suc- 
cessful as when conducted every day. It is possible that there is a 
limit to the contribution each type of CE activity can make, and in 
some cases, this can be reached with modest expenditure levels (e.g, 
$200 per pupil). However, even if there should be diminishing 
returns from a specific CE activity, there might be need for several 
types of CE for the same pupil. 
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TEMPO is aware of the conflicting views on the relation between 
gains in achievement level and expenditure level. It appears to us 
that statistical problems associated with multicolinearity and errors 
in measurement are probably covering up relations between expendi- 
ture level and achievement. It is hard for us to visualize that educa- 
tion runs contrary to many other phenomena studied by economists 
in which it has been found that increases in resources bring increases 
in returns. 

CHARACTERISTICS ASSOCIATED WITH SUCCESS OF CE 

The primary objective in the analysis of this topic was to deter- 
mine whether particular pupil- school- environmental characteristics 
(state-of-condition variables) are associated with the amount of suc- 
cess from CE activities. In this study there were only a few instances 
among the sample observations showing clear evidence of success 
from CE. Consequently, the analysis of state variables was associa- 
ted with change in achievement, regardless of whether the change re- 
sulted from CE or not. 

It appears that characteristics associated with the pupil and class- 
room are of considerable importance, but characteristics associated 
with the overall school are of lesser importance, • Figure 5 shows the 
change in the lowest decile by grade for each sample school in Dis- 
tricts 10, 13, and 14. For example, in District 10, the change for 
grade 3 in School 1 waa +4. 8; while the change for grade 6 in the 
same school was -9. 9 standard T-scores. Most schools in the sam- 
ple had both negative and positive changes for different grades. If 
factors associated with an entire school were the most important 
factors we would expect to see the various grades within a school 
grouped closely together. The approximately equal variation among 
grades within a school and among grades in different schools suggests 
the hypothesis that it is factors associated with the pupil and class- 
room that determine most of the year-to-year changes in achievement 
level. 

The state variables investigated include mobility, mean preachieve- 
ment level, attendance, change in attendance, percentage of Negro pu- 
pils, grade level, and school. When these data were collected, the 
above observation on importance of classroom and pupil data relative 
to school data had not been made. In addition, it was not feasible to 
obtain data at the pupil and classroom level for past periods. Conse- 
quently, data on all of the above variables represent averages at the 
school level. 
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Figure 5 , OlsiemKi cliqnges In reading Improwment, 1965 to 1966. 
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The results of analysis of the effects of high mobility are incon- 
clusive. The estimated regression coefficients for Districts 10, 13, 
and 14 are generally negative, but they are small and not statistically 
significant. This does not, however, constitute strong evidence of no 
effect from mobility. First, the mobility was measured as an aver- 
age for an entire school rather than the average for the pupils in each 
grade. Second, it is possible that pupils who do change schools do 
not get included in test results in a larger than normal percentage of 
cases. For example, they might be absent on the test day, or have* 
moved away before the test, or their test score dropped for some 
special reason. Because of the frequent reference to the problem of 
mobility by local school officials and the slight evidence of the nega- 
tive effect of high mobility from this study, the hypothesis that mo- 
bility has a significantly negative effect should be retained. The test- 
ing of this hypothesis, however, will have to be based on more exten- 
sive data than those used in this study. 

The mean preachievement level was the one state variable that 
most frequently showed up as closely associated with change in achieve- 
ment. Data for Districts 10, 12, I Stand 14 suggest that the lower the 
preachievement level, the greater the expected change in achieve- 
ment. However, there are two important qualifications that must be 
cited. First, the longitudinal data for District 8 did not show the 
same inverse relation as in the fixed-grade approach for the other 
four districts. Second, errors in measurement are known to bias 
the estimates of the correlation and regression coefficients associa- 
ted with a ''preachievement level" variable. After considering the 
possibility of bias, our best appraisal is that the true correlation be- 
tween change in achievement and preachievement levels in Districts 
10, 12, and 13 is indeed negative. 

One possible explanation of the observed difference in the correla- 
tion calculated from "longitudinal" and "fixed-grade" data is that the 
latter might represent situations where the best C£ was directed to- 
ward grades and schools which had the lowest achievement level. As 
in the case of mobility, this must remain a hypothesis to be tested. 

Neither attendance rate nor change in attendance rate appeared to 
be significantly related to change in achievement. 

Evidence from Districts 10 and 13 indicates that increases in per- 
centage of Negro pupils are associated with an overall decrease in 
achievement level. This is likely to reflect a lower than average 

^Measurement error bias is discussed in Appendix 6. 
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achievement level of Negro pupils at the time they move into a school 
rather than a smaller gain in achievement during the specified period 
when they were in a sample school. This result is in agreement with 
earlier studies, such as the Coleman study on equal educational op- 
portunity (Reference 9). 

There were few data in this study for analyzsing whether grade level 
is associated with observed changes in achievement. The information 
that was available in the fixed-grade data and the longitudinal data 
gave no evidence that amount or direction of change in achievement 
was related to grade level, ' 

m 

There was a great deal of variation in observed changes in achieve- 
ment among grades within sample schools, as is readily apparent in 
Figure 5 and in Figures 2, 5, 8, and 9 of Volume IE. Except for 
schools in which there was only one observation, none of the 46 schools 
analyzed appeared to have a significantly better or worse than average 
change in achievement. The figures also reinforce the observation 
that the mobility, poverty and attendance rate variables, which in this 
study were noeasurcd at the school level, might have differed signifi- 
cantly if measured at the grade level. 

ALLOCATION OF CE FUNDS 

Sample school districts allocated Title X funds over a wide range 
of CE activities. Table 2 shows the 28 different CE activities in 
District 8 arranged by order of magnitude on dollar expenditures 
per pupil. The allocation shown in Table 2 is typical of the alloca- 
tion in other sample districts. 

The allocation of Title I funds shows a fairly large expenditure per 
pupil for a small fraction of the pupils in Title I schools and a small 
expenditure per pupil for the majority of pupils. In District 8, for 
example, the four most intense activities accounted for 32 percent 
of Title I funds, but affected less than 4 percent of the pupils. In 
contrast toT'die intense activities it is noted that over 40 percent of 
Title 1 funds were spent on activities that involved less than $10 per 
pupil. Because of the small per-pupil expenditure on the majority of 
pupils, it seems reasonable to expect that significant enhancement 
co^d be d6t<rcted only among those few pupils who participated in 
intense CE activities. 

'There are many ways in which allocation of CE funds can be mean- 
. ingfully analyzed. Unfortunately, little data were available on what 
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Table 2. District 8 as cn example of the distribution of Title I funds. 



Activity 


Total Cost 
of Activity 
($000)c 


% of Total 
CE= 


No. of 
Pupils 


% of Pupils 
in Title I 
Schools 


$ Per 
Pupil 


1 


21,6 


2.0 


20 


a 


1,080.00 


2 


55.6 


s.o 


84 


0.3 


661.00 


3 


132.6 


12.0 


420 


1.0 


315.00 


4 


140.8 


13.0 


793 


2.0 


177.00 


5 


10.8 


1.0 


114 


0.3 


95.00 


6 


0.7 


0.1 


10 


a 


69.00 


7 


2.3 


0.2 


35 


0.1 


66.00 


8 


83.9 


8.0 


1,357 


4.0 


62.00 


9 


34.1 


3.0 


1,372 


4.0 


25.00 


10 


67.0 


6.0 


2,824 


8.0 


24.00 


11 


11.4 * 


1.0 


1,000 


30.0 


11.00 


12 


38.0 


3.0 


3,952 


12.0 


10.00 


13 


125.9 


11.0 


19,000 


58.0 


7.00 


14 


94.7 


9.0 


14,766 


45.0 


6.00 


15 


54.1 


5.0 


14,766 


45.0 


3.66 


16 


31.7 


3.0 


15,492 


47.0 


2M 


17 


3.8 


3.0 


3,032 


. 9,0 


1.25 


18 


17.9 


2.0 


15,492 


47.0 


1.20 


19 


27.3 


2.0 


17,590 


53.0 


1.20 


20 


17.1 


2.0 


15,492 


47.0 


1.10 


21 


31.8 


3.0 


33,000 


100.0 


0.96 


22 


14.6 


1.0 


15,492 


47,0 


0.94 


23 


27.0 


2.0 


33,000 


100.0 


0.81 


24 


9.4 


1.0 


17,590 


53.0 


0.53 


25 


14.5 


1.0 


33,000 


100.0 


0.43 


26 


6.7 


0.6 


17,590 


53.0 


0.38 


27 


1.7 


0.2 


4,560 


14.0 


0.36 


28 


4.3 


0.4 


33,OOC) 


100.0 


0.12 


Total 


1,100,0 


100.0 


NA** 


NA** 


NA^ 


Notei: 

°Uss than 0. 1 %. 
b • 

NA indicates that the total of the column is not meaningful* 
® Totals rounded. 
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priority system was set up in the budgeting process and what scheme 
was actually used in allocations of funds. 

I 

Although there are little data to test any hypothesis concerning 
allocation, TEMPO'S work suggests that the following decision vari- 
ables enter explicitly or implicitly at the district, school, and grade 
level: 



1. Intense expenditure for a few pupils versus very small exJ 
penditures for most or all pupils in Title I schools j 

2* CE for pupils who are at the lowest achievement levels 
versus pupils who are only slightly below average; 

3, CE for pupils who have some special handicap versus pu- 
pils who are probably below average only because of lesser 
amount or quality of education in earlier years; 

4, CE oriented directly toward the pupil versus activities 
oriented toward improving teachers; 

5, CE directly oriented toward academic skills versus CE 
directed toward nonacademic aspects, such as attitude, health, 
culturoiand recreation; 

6, Within academic skills, a division between CE oriented to- 
ward reading versus orientation toward skills such as mathe- 
matics, science, and music; 

7, Activities in testing, counseling, and guidance versus ac- 
tivities directly oriented toward overcoming educational dis- 
advantages; 

8, CE activities that are very similar to regular education 
versus CE that is more imaginative, innovative,* and oriented 
toward specific problems of target pupils; 

9* Decision on emphasis among grades kindergarden through 
12 ; 

10. Use of resources for additional personnel versus use for 
supplies, equipment, and construction; 
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11. CE activities during the regular academic year versus 
activities during the summer months; 

• 

12. Many different CE activities versus one or a small num- 
ber of CE activities; 

13. CE to meet objectives of and problems in school integra- 
tion versus those not associated with integration, ^ 

We present brief summary comments on each of the above 13 cate- 
gories but hasten to point out that they are based only on the five 
school districts reported in this phase of ttie study. 

1. I'here appears to be a general tendency to allocate a small 
percentage (25 percent or less of Title I funds) for a very small 
number of intense CE activities ($300 or more per pupil) and to 
allocate the remainder to a large number of low-intensity activ- 
ities affecting a large number of pupils. 

2, It was not possible to differentiate between the frequency 
of activities devoted to helping pupils who are the lowest 
achievers and the frequency of activities devoted to helping 
pupils who have a good potential and are usually only slightly 
below average in achievement. 

3, Since schools are selected for Title I funding oir the basis 
of family income, there is some emphasis on CE for children 
who are likely to have been limited by below-average educa- 
tional resources. Beyond this fact there is no information 
from this study about relative emphasis on special handicap 
versus educational deprivation due to lesser resources. 

4. Virtually all CE is oriented directly toward improving pu- 
pil performance rather than improving quality of teachers. 
However, it is debatable whether increasing staff should be 
considered pupil- oriented or teacher-oriented, 

5. Except for the first year, when considerable emphasis was 
placed on supplies, equipment, and construction, the major 
part of funds (usually 75 percent or more) has gone toward 
academic skills, 

6, Reading-oriented activities usually accounted for 80 percent 
or more of the funds devoted to improving academic skills (see 
Reference 50). 
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7. It was not possible to develop good estimates of allocation 
for testing and counseling guidance because it was frequently 
included as part of an overall CE activity. 

8. CE activities are predominately like regular education 
programs. 

9. TEMPO has no additional information on emphasis by grade 
level because of the way costs were analyzed in relation to the 
pretest and posttest dates. 

10. The breakdown by personnel versus supplies, equipment, 
and construction is available in the annual statistical reports 
and has been analyzed elsewhere (References 7, 30, 69, 70). 

o 

11. TEMPO obtained no significant additional information on 
allocation to CE activities during the summer versus aotivities 
during the regular academic year. 

12. There appears to have been a general view among local ed- 
ucation agencies (LEA) that there should be many different CE 
activities. The large number of categories specified on applica- 
tion forms and annual statistical reports probably encourages 
this view. 

13. An objective of reducing the problem and obstacles associ- 
ated with integration vyas explicitly mentioned in some instances. 
TEMPO data are too few to warrant any precise estimates of the 
relative emphasis on integration. Data in Appendices 1 through 
5 provide more detail on the above points. 

There is a set of decisions implied in the format of the "Annual 
Statistical Report of Title I Activities" and in the application forms 
for Title I funding. At some point each of these forms is filled in, 
but it is not clear whether they are meaningful categories or repre- 
sent a manageable number of decisions in budgeting and allocation. 

For example, the application form that the Office of Education sug- 
gests each local education agency use in making application to the 
state (References 66 and 57) has the following types and number of 
breakdowns: 

Objective i«»»five major and 23 subcategorles. 

Number of pupils by grade level— 13 (K through 12), 
Expenditures— 20 types of expenditure accounts, and 
Number of staff— 18 assignment categories. 
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The Annual Statistical Report that OE receives from each LEA 
‘ ha$ the foil owing types and number of breakdowns! 



* * * V " 
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Number of staff— 21 categories by type and assignment, 

* Total salaries— eight subcategories within teachers for 
handicapped, 

•Number of pupils by grade levels— 13 (K through 12), 

’ instructional activities— 18 categories (reading, music, etc,), 

■' ^ ''‘Number of pupils and total cost by type within instructional 
activities— 18 categories (reading, music, etc.), and 
Breakdown of total expenditures— three (equipment, construc- 
' tion, other). 

With' respect to the above breakdowns for allocation, it is possible 
to report cnly that data and discussions with local school officials do 
not indicate that these breakdowns were carefully analyzed in the al- 
location process, 

■' feels that each of the follov/ing questions must receive 

more complete attention: 

• Aspignment of priorities among alternative objectives in 



f' 



CE activities 

• ‘sBalimates of expected results from the various types and 
’ amounts of CE for specified conditions (pupil, school, 
environment) 






1 



I {Estimates of the most efficient manner and true cost per 
I ipupil of implementing specified CE actMtles. 



; ih^ri is virtually no information as to the weight that estimates 
ef the above factors played In decisions on allocation of CE 
fUnis wilhin any *of the five districts analyzed in this study. There 
appears jto be a pressing need for the XJ, S, Office of Education (or 
posjsiblyf state educational agencies) to provide mors guidance to 
LEA s for developing better estimates and evaluations within each of 
the ftiiree factors (see References 22, 27, 43, 55), 



yAR3ATlQN IN EXPOSURE TO CE 

? » For a given allocation of CE fundi within a school district there 
is f^'till 4onsiderahle variation In expofure to CE prior to the so- 
called poittest results, First, test ^itis varied from October to 
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O 

May during the academic year. This means that some pupils in the 
sample had seven more months of exposure to C£, even though post- 
tests were given in the same year. In Districts 12 and 14, TEMPO 
obtained test data for the fall of 1967, so the full year cf CE in 1966- 
67 could be brought into the analysis. Second, in the case of fall tests, 
the estimate of expenditures was based on the grade in the previous 
year. This means that high mobility rates can bias the estimate 
exposure to CE because pupils who took the test were not pupils who 
were exposed to the CE in that school. 

For the posttest results used in this analysis, pupil exposure to 
CE varied from 5 months (February 1966 to October 1966) to 14 
‘months (February 1966 to October 1967). For pupils who also par- 
ticipated in summer CE activities, the maximum exposure could 
have been 17 months* 

The best estimate of the range and average level of per-pupll 
expenditure for CE in the 12-month period preceding the pretests 
and posttests is shown in Table 3. The variations in these figures 

t 

Table 3. Summaty of expsndifute and stale variables. 





District 10 


District 12 


District 13 


District 14 




pie 


post 


pre 


post 


pre 


post 


pre' ; 


|:oit 


Expsndhurt Vartoblei 

$ per pupil for CE acHvlllts 
Minimum 


0 


0 


no 


143 


4 


44 


3 


13 


Maximum 


0 


88 


126 


368 


127 


355 


102 


150 


Avtroge 


0 


15 


112 


210 


35 


137 


33 


81 


$ per ptpll for regular teachers 














238 


217 


Minimum 


124 


141 


246 


214 


140 


191 


Maximum 


296 


311 


331 


383 


306 


414 


360 


382 


Averoge 


m 


195 


287 


293 


242 


266 


297 


318 


Stole Variables (Average for 4 
Dlitricti) 

Mobility Rate# Percent 


36 


m 


19 


•» 


64 




69 


m 


Negro Pupils# Percent 


93 


94 


72 


72 


45 


46 


56 


56 


Spanish Pupils# Percent 


1 


1 


0 


0 


27 


29 


0 


0 


Grade ADM (number of pupils) 


77 


77 




89 


86 


88 


82 


82 


Attendance Rate# Percent 


89 


92 


94 


95 


72 


72 


95 


93 


Mean (Standard T-Scores) 


















Achievement level 


40.2 


39.7 


:H*4 




40.7 


^2.1 


43.5 


43.1 
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reflect differences in allocatidri b£ fufids as v«rell afe.va^^^^ 

;: data: The effect of mobility could not be included ih the fignr^^ 

in the analysis arid sh-own in Table 3. As can be Seen, the average’ 

GE expeiiditures varied from $0 to $210 per! pupil, and among indi^ddual 
grades the variation was from $0 to $368: ' • • ’ . ‘ ' 

There is nO indication in the data for these five school districts! 
that GE funds replaced funds for the regiflar school program in Title 
I schools. If this had been the case, oiie would expect to ftnd a nega- 
tive correlation between GE and regular expenditures. In some cases, 
such as in the "Glasses of Twenty" activity in District 8, the entire 
funds came from GE. But in this as well as other cases the total funds 
were generally greater than they -would have been under the regular 
program. 

The mean value for each of several state- of-condition variables is 
as shown in Table 3. Available data do not show that the amOurit of 
exposure to GE was closely related to any of the state variatbles con- 
sidered in the analysis, with the possible exception Of the inean pre- 
achievement level. 

o 

COMPARISON OF FIXED-GRADE AND LONGITUDINAL ANALYSES 

The three main types of differences in the fixed-grade and longi- 
tudinal analytical approaches are: 

1. Differences caused by sampling variation in .meas^ringj 

changes in achievement, ] 

2. Differences between the types of pupils actually enrolled 

and the oilier pupils in the same grade^ V. ^ 

3. Differences in measures of intensity of GE prpg:^ams be- 

cause only part of the pupils in a grade were actually e3q)oged 
to the major GE activities. M 

The use of longitudinal daita In analysis of District 8 GE provides 
some information on the value pf obtaining and using lopgitudipal 
data but is hot definitive as to whether the added cost of obtaining 
arid analyzing longitudinal data is warranted.; ’ ’ 

. In the first. type of difference, ;the fixed-grad^ approach involves 
two different groups of pupils but the. same test, while the longitudinal 

■■■ ^ 
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approach involves the same pupils but two different tests because of 
different grade levels before and after exposure to CE. The only new 
information that analysis of District 8 CE provides on relative error 
of measuring changes in achievement shows that the correlation be- 
tween pre- and post- scores for 95 grade 6 pupils from nine schools 
was 0. 76 as compared to correlations of 0. 68 and 0. 74 between the 
pre- and post-mean- scores for Districts 10 and 13. If these correla- 
tions are a measure of reliability of measurement, there is no signifi 
cant difference. At best, however, these correlations are a very 
crude measure of reliability and TEMPO feels that these results pre- 
sent little information on the first type of differences between the two 
approaches. 

There is another calculation that is relevant to the first type of 
differences. In the Reading Improvement activity only about 20 per- 
cent of the pupils in a grade were involved. This means that the 
average change of 1. 09 grade equivalent units for pupils who actually 
participated would yield an average change of only 0. 21 based on the 
total of both participating and nonparticipating pupils. Unless the 
percentage of pupils involved in CE is known so that an adjustment 
can be made, the calculated average change of 0. 21 would present a 
distorted view of the effect of CE. Further, in testing the statistical 
significance of observed changes, the sampling variation among the 
80 percent nonparticipating pupils would reduce the discriminating 
power of the test. 

There is more information with respect to the second type of dif- 
ference. As shown in Table 55 of Volume II, knowledge of the char- 
acteristics of the specific pupils involved made it possible to estim- 
ate that they progress at a rate of about 0. 65 grade -equivalent units 
per year, coihpared to 0. 96 for the other pupils in the same grade. 

In this instance it was possible to improve the accuracy of the "stan- 
dard" for measurement by a factor of 0, 5 {=* [0, 96-0. 65] /-65). This 
is very significant. If the difference between pupils exposed to CE 
and other pupils in the same grade were known, the observed aver- 
ages in the fixed-grade approach could be adjusted; but the calcula- 
tions would be quite complex and, therefore, sensitive to error in 
measurement. 

Tables 44 and 45 of Volume II provide data for evaluating the third 
type of difference in the two approaches. These data show how the 
intensity of various CE programs would be distorted if expressed in 
terms of the average of all pupils in the grade. For example, the 
average per -pupil expenditure for the 20 pupils participating in 
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District 8 Activity VIII D was $1, 080. This would appear negligible 
if averaged over the approximately 10, 000 pupils in grades 1 through 
6 in the schools from which these pupils came. The average per- 
pupil expenditure in the Classes of Twenty (Activity IX) was $316, 
and this would have been negligible if averaged over the approximately 
600 pupils in a school rather than the actual enrollment of 20 pupils. 

Eight of the activities listed in Table 45 of Volume II had a per- 
pupil expenditure greater than the approximate $50 total CE per pupil. 
It does not seem reasonable to expect that specific activities such as 
those listed in the table could be effectively evaluated using the fixed- 
grade approach. 
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SYNOPSIS OF TEMPO PHASE I STUDY 



OBJECTIVES 

During the Phase I study, data were analyzed from a sample of 
schools in 11 school districts which have received federal funds 
for the operation of compensatory education programs for disadvan- 
taged children. The objectives were to develop preliminary answers 
to several important questions concerning the effects of compensa- 
tory education programs; 

1. Has statistically significant enhancement of pupil perform- 
ance resulted from compensatory education programs? 

2. What school, pupil, and environment characteristics are 
associated with enhanced pupil performance? 

3. What are the distinguishing features of successful compensa- 
tory education programs? 



SUMMARY OF RESULTS 

The sample included 132 schools which received funds from Title 
I for compensatory education to aid educationally disadvantaged pupils. 
Most of the 11 school districts from which the schools were drawn 
were selected because there was reason to believe that successful 
compensatory education programs were in progress in at least some 
of the district schools. Conclusions were based on a comparison of 
achievement scores in 1966-67, after pupils were exposed to com- 
pensatory education from Title I funds, with pre-exposursi achieve- 
ment scores in 1965-66. 

There appeared to be a slight decline in average pupil achievement 
level in the sample schools. For the entire sample the average grade- 
equivalent score in 1966-67 was approximately one-half month lower 
than the corresponding grade equivalent score in 1965-66. 
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On the other hand, there appeared to be a slight improvement in 
achievement of pupils who were at the lowest achievement levels in 
their respective grades. The average grade equivalent score of pu- 
pils at the lowest decile in the 1966-67 tests was approximately one- 
fourth month higher than the average grade equivalent bco ^ ^ of cor- 
responding pupils on the 1965-66 tests. Although the one-, ^urth 
month change was very small, it was statistically different .'rom the 
observed negative changes in both the mean score and the score at 
the upper quartile. 

There was considerable variation in changes in achievement 
among school districts. One district showed a statistically signifi- 
cant increase in the average score while two showed significant de- 
clines. With respect to achievement at the lowest decile, none of 
the school districts showed significant decreases, but two districts 
did show significant increases. 

The preliminary results of the study suggested that amount of 
improvement is related to level of Title I expenditures. The dis- 
tricts which showed the greatest improvemenfc-at the lowest decile 
were the districts which had the higher average Title I expenditures 
per pupil. 

The two variables most closely related to changes in achievement 
were initial achievement level and percentage of Negro enrollment. 
Lower initial achievement levels in 1965-66 were associated with 
larger gains between 1965-66 and 1966-67. This suggested that the 
availability of Title I funds was probably helping pupils at the lowest 
achievement levels the most. Schools which had 40 to 60 percent 
Negro pupils showed the poorest response to compensatory education 
programs. Schools with 0 to 20 percent Negro pupils showed the best 
response. 

It is always possible that the positive changes which were attribu- 
ted to CE were due to sampling variation. Failure to draw conclu- 
sions on statistical results also involves risk. There can be a loss 
to society in failing to support a program that is actually successful 
but whose success cannot be clearly substantiated by available data. 
Our conclusions and ths detailed discussions in the remainder of the 
Phase I report are an objective evaluation within the constraints of 
available data^ However, it must be kept in mind that Title I funded 
programs were still relatively new at the time of 1966-67 tests, and 
it is not reasonable to expect conclusive evidence of enhancement in 
achievement so soon. 
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The overall Phase I study provided considerable evidence that 
more specific studies were needed to evaluate properly the effects 
from Title I, c^nd that more emphasis should be placed on getting 
participating schools to keep systematic records on pupil, school, 
and program characteristics. The records from many schools were 
not adeqiiate for the types of analysis required to evaluate properly 
compensatory education. 

Because the Phase I study results were not definitive, a Phase II 
study that would concentrate in more depth on 5 of the 11 districts 
was recommended. The Phase II study was to emphasize investiga- 
tion of trends in achievement and to derive and analyze better estim- 
ates of CE activities employed at each grade unit included in the 
sample schools. 

METHODOLOGY AND SAMPLE SELECTION 

The study focused primarily, though not exclusively, on the im- 
pact of programs funded under Title I of the Elementary and Second- 
ary Education Act during the first 18 months of its operation. The 
effects of compensatory education programs on pupil performance 
were assessed by comparing results on achievement tests and atten- 
dance rates prior to and after eaqposure to compensatory programs. 

Data for this study were obtained from 11 school districts chosen 
for analysis because there was reason to believe that successful 
compensatory programs were in operation in at least some of the 
schools. ^ Within each district visited, a sample of schools was 
selected to reflect differences in the following characteristics: 
racial composition, degree of economic or educational deprivation, 
size of enrollment, history of prior compensatory programs, and . 
intensity of current programs. 

While schools were designated for inclusion in the study, for sev- 
eral reasons the grade rather than the school as a whole was the unit 
chosen for analysis in the study. The measures of student perform- 
ance used are available for specific grades but not for all grades 
within a, school. More important, compensatory programs are not 
necessarily spread evenly throughout the grades within a school or 
school system. Aggregating data on the resources and participation 
in compensatory programs for a whole school or aggregating student 

J ill i — 1 1 

>!«Although 14 school districts were originally included ia the study, 
only 1 1 had data readily available for use in the studV. 
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performance for a whole school is likely to mask the effects of com- 
pensatory education. Therefore, data on pupil performance, des- 
criptions of compensatory programs, and expenditures for both regu- 
lar and compensatory programs were gathered by grade for the 132 
schools included in the sample. 

' * » . * .1 1^1 1 • 

The primary measure of achievement used in the study Was thfe 
score on the reading subportion of various standardized achievement 
tests. Although reading may not be an appropriate measure of Suc- 
cess for all the objectives of compensatory programs, it is a funda- 
mental academic skill and is a central feature of a majority of oidm- 
pensatory projects throughout the country. 

The analysis of achievement test results employed a "fixod-^grade" 
approach in measuring the effects of compensatory programs j-'- The 
distribution of achievement scores for children in a particular 'grade 
and school for tiie year preceding exposure to compensatory education 
was compared with the distribution of achievement scores f6r a^dif- 
ferent group of children in the same grade and School in the fallowing 
year, when compensatory education programs had been implifflShted. 

It was assumed that, in the absence of special compensat6ry*J]^ir0grams, 
the pattern of achie vement scores in a grade would remaift bOhiSlant 
from one year to the next* Thus, changes in the distribution' of ^est 
scores between the two years would reflect the impact of participation 
by the students in compensatory programs. The usefulness and 'valid- 
ity of the fixed-grade approach were governed by the ability to identify 
and cope- with the additional factors introduced by comparing' results 
for two different sets of pupils. That is, any changes in th^'^a'feliieve- 
ment pattern from one year to the next must be evaluated' iU5 light? of 
normal changes in the level of educational services provided by^ the 
'school district and changes in the socioeconomic composition iof the 
student population. -Either or both of these factors can influence the 
academic performance from one year to the next of the pupils i h o. 
grade. . ■ -J ' 

' ■ >) hiiUiiiii 

The most important uncertainty in relying on observed* differences 
in test scores in successive years to assess the effects of' compensa- 
tory programs arises out of the possibility of trends in achievement 
scores which are independent of compensatory education,- 'There was 
reason to expect a downward trend in the achievement level of pupils 
at inner-city schools (which constitute most of the sample) • relative 
to the entire nation. This decrease in achievement scores'^for^a'igiven 
grade level over time has been associated with changes in tho Socio- 
economic composition of the student population. 

0 
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An alternative approach involves the analysis of changes in the 
.achievement test scores of the same students or groups of students 
throughout a given time. Longitudinal analyses are attractive because 
. some variables are held constant. In this study, the choice of the 
fixed-grade approach was dictated by the difficulty in obtaining sub- 
stantial amounts of longitudinal data. School systems do not as a rule 
test each grade each year. Further, high pupil mobility, the absence 

• of centrally maintained cumulative records on individual pupils, and 
. the difficulty at the time of the study of linking a pupil’s test scores 

- to his participation in particular compensatory programs ruled out 
. the longitudinal approach. 

Most of the analyses in ihis study were based on test data for 
,;.i aoademic years 1965-66 and 1966-67. The former (1965-66) was 
..•considered the "pre" year, or the year prior to compensatory edu- 
. cation-programs, and the latter (1966-67) as the ’’post” year, or the 

• year in which there had been some exposure to compensatory pro- 
.grams*. Although study teams collected information on compensatory 
..programs regardless of the source of funding, the nmjor infusion of 

ji., I suited from Title I, Funds from Title I did not reach school 
nntil the spring of 1966, and in many cases the activities 

• . fppnjSp^ed under Title I did not begin until the end of the school year, 
jt -was assumed, therefore, that the benefits of compensatory pro- 

, j .gra.ms would not begin to be evident in achievement test scores until 
; .thjC 1966-67 school year. 

:.-.i':if /vSelatively few school systems keep records on the amount and type 
..j/.pfjppmpensatory programs in specific grades at a school, nor was it 
possible to identify the specific students within a grade who 
*.-:?verfetparticipants in compensatory programs. Consequently, it was 
decided to use test results for all pupils in a grade and to gather in- 
.formation on all grades in the sample schools which had been tested 
with the same achievement test in both 1965-66 and 1966-67. Of the 
150 schools originally selected for inclusion in the sample, 132 con- 
tained one or more grades— distributed as shown in Table 4 — for 
.'i ^iwhiifihi (achievement test data were available for the two academic 
•• •..•-;years in- question. The sample includes the test results of 314 school 
;■ grades^for each of the two years. The total number of students in the 
. . sample is just under 35, 000 for each year. 

« * ’• * 

' Pata analysis was limited to standardized achievement tests ad- 
f . ministered to entire grades of pupils in a school district for each of 
j.^two years, 1965-66 and 1966-67, In the 11 school districts in which 
achievement test data were available, four different tests were used— 
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Table 4. Distribution of the school grades used in the analyses of achievement 




the Stanford Achievement Test (SAT), the Metropolitan Achievement 
Test (MAT), the Iowa Tests of Educational Development (IT ED), and 
the Sequential Tests of Educational Progress (STEP). There was no 
consistent pattern among the sample districts either of grades tested 
or of type of test used. 

Results of the achievement tests used In the 11 sample districts 
were received in a variety of forms— class listings of individual pu- 
pils, punched cards of individual scores, computer tab runs by indi- 
viduals, and computer printouts of frequency distributions. Test re- 
sults were provided in terms of raw scores, standard scores, grade 
equivalents, percentile scores, and stanines. In order to work with 
such a variety of tests and test results, all scores were converted to 
national percentiles and then to a common form— the Standard T- score. 
The distribution of Standard T- scores in the population is constructed 
to be normal, with a mean of 50 and a standard deviation of 10. T- 
scores can be averaged and subjected to other simple statistical analy- 
ses, whereas other types of scores (such as percentiles) cannot. In 
some of the analyses, results for different grades were combined under 
the assumption that differences in T- scores are also comparable among 
grades. That is, the amount of movement involved in raising an 
achievement level by five points in one grade is approximately the 
same as a similar amount of movement in other grades. 
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ANALYTICAL RESULTS 

Reiultt of the Bta-tietlcal anelyeei performed on th« achievement 
toit data are diicuaied in termi of average changei or the frequency 
of poiltlve and negative changei. The data have been grouped in sev- 
eral different wayi for showing relevance to each of the questions 
being addressed. 

Bihoncsment of Achlavsmt nt from CE 

The term “enhancement” is defined as the difference between 
achievement level after exposure to some compensatory education 
programs and the achievement level which would have been expected 
in the absence of mdh programs. While it is possible to measure 
the achievement level of pupils who receive compensatory education, 
the achievement level of the same pupils in the absence of coj/npensa- 
tory programs must be estimated. The results of most of tlte statis- 
tical tests presented below were based on observed differences in 
achievement scores between 1965-66 and 1966-67 rather tlian the 
estimated difference between achievement with and without exposure 
to compensatory programs. The operative assumption v/as that the 
distribution of achievement scores should not change from one year 
to the next. That is, no adjustment was made for possible trends in 
the level of achievement within a grade. Thus, if there were in fact 
a do-ynward trend in the level of achievement, the observed differ- 
ences between the two years is an overly pessimistic estimate of the 
differences between achievement with and without compensatory pro- 
grams. 

OVERALL SAMPLE. There was no indication of general improve- 
ment in the average achievement level of the entire student popula- 
tion in the 314 school grades analysed. There was, hor-^ver, an 
indication of a slight improvement in the achievement level of stu- 
dents at the lowest achievement levels in their respective grades, 
as shown by Table 5. 

Although it was not possible to link the performance of students 
on achievement tests with their participation in compensatory pro- 
grams, there Is reason to believe that compensatory programs, es- 
pecially remedial ones, wore usually oriented toward the most 
seriously disadvantaged students or those witli the lowest achieve- 
ment scores. This means that we might hope for more favorable 
results for students at the lower achievement levels (e. g. ,‘ the 
lowest decile) than for students at higher achievement levels. The 
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Table 5 , Average change In reading achievement test scores for the total sample* 



AchlevemenI Test Statistic 


Average 

Change® 


Standard 

Error 


Significance 

Level^ 


Lowest Decile (Dij 


+0.25 


0.18 


0.20 


Lower Quartlle (Q^) 


-0.30 


0.16 


0.10 


Mean (X) 


-0.29 


0.13 


0.05 


Upper Quartlle (Qg) 


-0.48 


0.17 


0.01 


Notesj 








°ln units of Standard T-scores and based on observed changes in 314 school grades 


In 11 districts. 








b 

The probability that the observed sample result could have happened by chance 


If the hue change between 1965-66 and 1966-67 was Indeed zero. 



change in achievement scores at the lowest decHe across all o£ the 
grade levels was positive, but represented only about one-fourth of a 
month in terms of grade equivalent units. If, however, this small posi- 
tive value indicates a reversal of a negative trend, it is of considerable 
importance. 

« 

There was a slight decline in achievement at the' mean and the first 
and third quartiles for all of the grade levels in the sample schools. 
These results suggest that even with compensatory education programs 
present, there is a slight negative trend in achievement level of inner- 
city schools. 

The positive change in the lowest decile, while not very large, be- 
comes more significant when contrasted with the negative changes in 
the mean and the first and third quartiles. In the absence of special 
compensatory programs, one would normally expect the four statis- 
tics to move in the same direction since they were derived from the 
same iistribution of achievement scores. The probability of the ob- 
served improvement occurring at the lowest decile and the observed 
decline at the mean and the first and the third quartiles would be un- 
likely by chance alone. Hence, this could be an indication of a posi- 
tive effect of compensatory programs if one assumes they are usufJtlly 
concentrated on the lowest achieving students in a grade, 

MDIVIDUAL districts And variation among districts. There 

was wide variation in the pattern of achievement changes which occurred 
within and among the sample school districts (as shown by Table 6), 
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Table 6* Average change In mean reading tesf scores by districh 



School District 


No. of Grades 
Observed 


Average Change 
In Mean*^ 


Average Change 
in Lowest Decile® 


1 


39 


40.25, 


+O.0S 


2 


56 


-1.35® 


+0.M 


3 


42 


-0.34, 


+0.22 


4 


27 


-1.03® 


•■0.68 


5 


28 


-0.16 


-0.70 


6 


4 


41.28 


+4.20 


8 


55 


-0.37 


+0.26 


10 


13 


-0.21 


+0.55 


12 


4 


+0.42,^ 


+1.78. 


13 


32 


+1.16® 


+1.3^ 


14 


18 


+0.01 


+0.04 


Notes! 

units of Standard T*^ores. 

Statiitkaily significant at the 5 percent confidence level. 





Nine o£ tbe eleven districte show a positive change at the lowest dec- 
ile, but only one district shows the change to be statistically significant 
at the S percent confidence level. The sampling variation lor the mean 
is smaller, and here we find ^rea of the eleven districte showing a 
statistically significant change. 

There appears to be significant differences among Ihe districts. 

The -{ 4. 20 change for District 6 probably reflects large sampling varia- 
tion because there were only four observations. Howevsr, l^s range 
between the ■fl. 16 change in the mean for District 13 and -1. 35 
change in the mean for District 2 is large. This repressnls a diffsr- 
ence of approximately 2. 5 grade-equivalent months over a 12-month 
period. 

CboractsrlsHc* Aiiocfoted with Bnhonctd Performcmce 

Changes in pupil performance were analysed in relation to a number 
of variables reflecting school, pupil, and environmental characteris- 
tics. The variables chosen for examination included grade level, de- 
gree of economic deprivation, student mobility, proportion of Negro 
pupils in tiie school in the 1965-66 school year, change in Negro 
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enrollment, proportion of Spanish- speaking students in the school 
during the 1965-66 school year, mean reading achievement level in 
the school during the 1965-66 school year, mean attendance rate at 
the school in 1965-66, change in rate of attendance from 1965-66 to 
1966 - 67 , size of school, and size of grade. Several different types 
of analyses were carried out in an attempt to identify the relation- 
ships between eac^h of the variables and changes in achievement. The 
results of these analyses follow. 

GRADE LEVEL AND CHANGE IN ACHIEVEMENT. There may be 
critical grade levels in the normal 12 years of public education dur- 
ing which it is relatively easy to compensate for the effects of educa- 
tional deprivation and other grade levels when it is relatively difficult. 
If educationally deprived children are given special help at the appro- 
priate grade level, they may be able to overcome most, if not all, of 
their disadvantages. It is generally held that the early grades are 
the most important levels of intervention. 

In this study, however, the results of several different analyses 
provided no evidence that changes in achievement were related to 
grade level. 

ECONOMIC DEPRIVATION. One of the criteria for selection of 
schools to participate in Title 1 of the ESEA is a high concentration 
of children from low-income families in the school attendance area. 
The standa>rds used to determine eligibility for Title I and to define 
the number of low-income children in a school vary from school 
district to school district. In view of these differences in the defini- 
tion of "low income, " it was not possible to devise a single scale of 
economic deprivation for all 11 districts. Therefore,, each school 
in the study was classified as being high, medium, or low in terms 
of economic deprivation relative to all Title 1 schools in that district. 

None of the analyses performed indicated any reliable relationships 
between degree of economic deprivation and changes in achievement- 
test scores. 

MOBILITY. High student mobility is a condition that is likely to 
dilute the effects of ooihpensatory education for several reasons. 

The range of compensatory programs can and does vary from school 
to school, so that a student who transfers from one school to another 
may not be able to continue in the same type of compensatory program 
Moreover, the disruption caused by transferring may have an unde- 
sirable effect on the student's general performance. High rates of 
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mobility make it difficult to assess the effectiveness of compensatory 
programs at a school since many of the students taking what we have 
called the "posttest" may have had very little exposure to the com- 
pensatory programs in the school in which they are tested. 

The results of the analyses performed gave inconclusive evidence for 
the effects of mobility on changes in achievement. Two of the analyses 
yielded opposite results on the possible negative effect of high mobility. 
This might have been caused by mobility being correlated with other 
variables which also influence changes in achievement, 

NEGRO ENROLLMENT. There appears to be a nonlinear relationship 
between changes in achievement between 1965-66 and 1966-67 and the 
proportion of Negro students in a school. Of the 132 schools in the 
sample, those with relatively low Negro enrollments (less than 20 per- 
cent) and those with relatively high Negro enrollments (more than 80 
percent) tended to show statistically significant positive changes in 
achievement at the mean, the first quartile, and the first decile. The 
group of sample schools in the 40-59 percent Negro category showed 
statistically significant negative changes in achievement at the mean 
and at the first quartile. Since there was considerable variation in 
racial composition among the sample districts, it might be thought 
that these results simply reflect difference among districts. However, 
further statistical tests indicated that the relationship between changes 
in achievement and percentage of Negro enrollment is similar within 
each of the districts. 

CHANGE IN NEGRO ENROLLMENT, There were 26 sample schools 
in which th(B Negro enrollment at the school changed 5 percent or more 
between 1965-66 and 1966-67, These 26 schools contained 53 school- 
grade observations, of which 41 increased in percentage Negro and 12 
decreased. Changes in achievement-test scores at the mea.n and first 
decile for these school grades indicated that relatively large changes 
in percentage Negro in either direction are associated with less favor- 
able changes in achievement. 

SPANISH-SPEAKING ENROLLMENT. Several of the districts in the 
sample had sizable proportions of Spanish- speaking pupils. The 
analysis did not reveal any significant relationship betv/een percentage 
Spanish and change in achievement. These results were not decisive 
since the statistical tests were based on a small subsample, and there 
was little variation in percentage of Spanish- speaking pupils among 
schools within each district. 
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MEAN READING LEVEL, 1965-66, It is reasonable to expect that 
compensatory education programs are being directed at the most 
educationally deprived students rattier than those with relatively 
high achievement. Therefore, the nature of the program would sug- 
gest a negative correlation between change in achievement and orig- 
inal achievement level — that the most dramatic increases would come 
for students at the lowest end of the achievement distribution. The 
analyses performed in this study substantiate the hypothesis. 

MEAN ATTENDANCE RATE, 1965-66. For the sample as a whole, 
there was a small positive correlation between rate of attendance and 
clmnge in achievement. 

CHANGE IN ATTENDANCE RATE. Attendance is assumed to vary 
with pupils* motivation to learn. Increasing rates of attendance might 
therefore be positively associated with chctnge in achievement. Cor- 
relations computed from the sample data showed no clear relationship 
between these two variables. The measures of change in attendance 
were crude, since the definition of attendance differed among the sam- 
ple districts, and there were no controls for other factors (such as 
weather or illness) which might affect attendance rates. 

SIZE OF GRADE AND SIZE OF SCHOOL. The statistical evidence 
showed no significant relationship between changes in achievement 
and the number of pupils in a grade or the size of ttie school. 



Distinguishing Features of Successful CE. 

The main focus of this study was on changes in achievement test 
scores between 1965-66 and 1966-67 and the relationship between 
those changes and selected pupil- school-environmental variables, 

' It was possible, however, to make two preliminary examinations of 
the effects from different levels of expenditure for compensatory 
programs on achievement. The first was the inclusion in regression 



^Because of imperfections in our measuring instruments, it was 
thought that there might be a built-in correlation between original 
levels of a variable and changes in that variable from one time to 
another. However, further statistical tests showed that the observed 
negative correlation between initial level «nd gain in mean achievement 
scores cannot be attributed to an artifact of test unreliability but should 
) b'e accepted as indicating a true negative relationship. 
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analyses of a variable indicating average Title I expenditure per pupil 
in each sample district. The second examination involved case studies 
of specific compensatory programs at particular grades in two districts 
as prototype studies of estimating cost arid analyzing results of compen- 
satory programs. 

EXPENDITURE PER PUPIL. In order to relate expenditures to 
achievement test results, a new variable, "effective Title I dollars 
per pupil, " was created. For each sample observation this variable 
was computed as the sum of average Title I dollars per pupil in 1965- 
66 plus a portion of the average Title I dollars per pupil in 1966-67. 

The portion used for 1966-67 was based on the fraction of the academic 
year which had elapsed up to the date of the 1966-67 test for each 
specific grade unit. This variable did not take into account any funds 
other than Title I which might have been expended by the school dis- 
trict for compensatory programs. 

For the 11 districts, there was a positive correlation between ef- 
fective Title I dollars per pupil and changes in achievement test scores. 
The correlation was statistically significant at the 5 percent level for 
each of the four measures of achievement — change in the mean, change 
in the first decile, and changes in the first and third quartiles. 

At the level of specific school districts, there also seemed to be a 
congruence between changes in achievement-test scores and effective 
Title I dollars per pupil. The three districts with the highest level of 
Title I funding had the largest gains in achievement at the first decile. 

These positive findings should be regarded as a very crude attempt 
to determine the overall relation between level of funding and achieve- 
ment change. The findings were based on highly aggregated data which 
did not give a true picture of what is happening at the grade level. 
Analyses of achievement change indicated that not only was there great 
variation in performance among districts, but also great variation 
among schools within a district and even among grades within the same 
school. * 

TWO CASE STUDIES OF SPECIFIC CE PROGRAMS 

In order to develop reliable estimates of the contribution of com- 
pensatory education to enhanced pupil achievement, it is necessary 

5{«The Phase II study considers the relationship between changes in 
achievement and the kinds and costs of compensatory programs at the 
grade level within sample schools in five districts. 
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to measure; or estimate resource expenditures and to describe pro- 
grams at the same level at which pupil performance measurements 
(e. g. , achievement and attendance) are made. While pupil per- 
formance measures were available for grades within schools, com- 
pensatory program descriptions and financial data were primarily 
available; for the school district as a whole. Program description 
and financial data at the district level— -or even at the school level — 
of aggregation masked the variation in programs and expenditures 
which occurred within a school in any school district. It is, there- ' 
fore, necessary to estimate the program participation and resources 
expended for particular grades within a school. 

Wide disparities existed among the sample school districts in the 
amount, degree of detail, and level of aggregation of data on com- 
pensatory program descriptions and expenditures. It was obvious 
from data received from school districts that substantial additional 
effort would be required to extract, summarize, standardize, and 
process the information and to assign values to the variables which 
would be used in subsequent attempts to identify the characteristics 
of successful compensatory pro^ams. Two of the school districts 
in the sample were selected to determine the feasibility of assigning 
compensatory program resources to the grade level. The case 
studies of these two districts were designed to yield a better under- 
standing of the variation in types of compensatory programs, dura- 
tion, and intensity of pupil participation in those programs and the 
specific amounts expended for each grade in the two districts. More 
important, the case studies were undertaken to provide guidance on 
the preferred method for assigning these resources to the grade 
level for all sample schools in the second phase of this study. 

Information Required 

The objective of each case study was to obtain detailed knowledge 
of compensatory programs, schools, and pupils. Both case studies 
sought to determine the resources normally devoted to each grade as 
a part of the regular school program in the district and the additional 
programs and resources added to the grade by the compensatory 
education programs of the district. Once identified, the incremental 
services and resources provided to the grade were related to avail- 
able measurements of pupil performance. 

Both case studies attempted to catalog all of the compensatory 
services made available to a grade and to estimate the resources ex- 
pended to provide those services. Fragments of information on the 
regular school program and compensatory activities had to be assem- 
bled from many sources. The following list illustrates the kinds of 



43 



SECTION 4 



information considered necessary for later attempts to analyze the 
relationship between the compensatory services provided and pupil 
performance; 

1. Program descriptions — objectives, activities, personnel 
assigned, materials and supplies used, pupils (by schools and 
grades), time and duration of program, and pupil jjarticipation 
and exposure; 

2. School /pupil characteristics — ethnic composition, economic 
status, relative academic level, staff composition and turnover, 
and special classes; 

3. Attendance records by school and grade — average daily at- 
tendance, average daily membership, gains, losses, percent 
attendance and absence, and unusual factors or events influenc- 
ing attendance; 

4. Financial records — district budget and expenditure reports, 
expenditures by school and project for regular and special pro- 
grams, expenditures by time period^ and sources of funds; 

5. Evaluation reports — objectives, activities, staff and pupil 
participation, project expenditures by time periods, staff and 
pupil performance, and measurement devices and their charac- 
teristics. 

The Two Approaches 

Different approaches to the allocation of resources to the grade 
level were employed in the two districts selected as case studies. 

The approaches were dictated by the availability of program and 
financial data from the school districts. 

In one of the districts (District 10), financial data were available 
for individual schools, both for the normal school program and for 
compensatory programs. Information was collected on compensatory 
education activities authorized for the sample schools. Compensatory 
resources were then distributed to the grades within the schools based 
' on these authorizations. 

A different approach was used to describe compensatory programs 
for District 13 because of the absence of any financial data on a school- 
by- school basis* The approach used in District 13 began with’the iden- 
tification of the specific programs implemented at each grade within the 
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sample schools and used available financial data to estimate the re- 
sources required to carry out these activities. 

The District 10 approach assumed that compensatory programs 
were implemented in reasonably good agreement with the original 
proposal or project description and that there was little variation in 
the implementation of programs among schools, except as indicated 
in the planning documents. In other words, it was assumed that a 
reading program at one school was operated in the same grades, for 
approximately the same number of particips^nts, and for approximately 
the same expenditure of resources as the same reading program at 
another school. The approach used in District 13 attempted to catalog 
the distribution of program resources which actually occurred at the 
grade level in a school. It avoided the assumption that there was little 
or no variation in the operation of compensatory programs at different 
schools. Because it dealt with what actually occurred, the approach 
used in District 13 required more detailed information about pupil 
participation, staffing, costs, and changes of programs in a school. 

The second approach was the more time consuming of the two but 
was more desirable in view of the observed deviation from original 
compensatory program proposals in many of the sample school dis- 
tricts. In some instances, variation in compensatory programs from 
school to school or grade to grade during the first semester of Title I 
(spring 1966) resulted from an inability to hire staff in the middle of 
a school year or to obtain equipment, supplies, and materials on 
short notice. The conduct of a given program during the follovdng 
school year (1966-67) was more likely to be in accord with the budget 
and plan of the school district. 

For District 10, where school-by- school expenditure data were 
available, the initial step in allocating compensatory program re- 
sources to the grade level involved assembling descriptive informa- 
tion on each compensatory project in the sample schools. Next, 
descriptive and quantitative summaries wefe prepared for compensa- 
tory projects indicating |1) the numb^^r of schools in the district and 
in the participating sample, (2j the number and grade level of pupil 
participants, (3) total and per-pupil expenditure, and (4) hours of pu- 
pil exposure. Finally, when the grade levels served by each project 
had been identified, reported expenditures were allocated to appro- 
priate grades by project and time period for each sample school. 

District 13 did not maintain financial data by school. It was pos- 
sible, however, to obtain fairly detailed compensatory program 
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descriptions on a grade-by-grade basis. Once the compensatory ac- 
tivities pursued in a grade were identified, it was necessary to cumu- 
late a catalog of resource inputs from various sources and to estimate 
their costs. For each compensatory project and for each grade in a 
sample school, the following information was gathered: (1) number of 
equivalent full-time teachers, (2) number of direct pupil beneficiaries, 
(3) average size of participating pupil group, (4) average hours per 
week per participant, (5) weeks of exposure per pupil, (6) instructional 
salaries, and (7) other expenditures. * 



Conclusions from the Cose Studies 

Although different approaches were utilized in the two cases 
studied, several findings emerged which were common to both. 

Wide variation was found in the extent and types of compensatory 
programs operating among schools in the same district and among 
grades within the same school. Similarly, considerable variation 
from year to year in per-pupil expenditure for both compensatory 
programs and regular school programs was found to exist among 
schools and among grades within a school. This suggests that both 
types of expenditures should be considered in the evaluation of the 
effects of compensatory education funds on the enhancement of 
achievement. 

For each of the two districts studied, estimates of resources, 
based on expenditures for regular and compensatory education pro- 
grams, were prepared for each grade in the sample schools. To il- 
lustrate the use of these resource estimates, selected comparisons 
were made between changes in expenditures and changes in achieve- 
ment test scores. In District 10, no relationship appears to exist. In 
District 13, a positive relationship was observed between, change in 
achievement scores and expenditures for a small sample of grades 
and schools. 

No firm conclusions should be drawn about the relationships be- 
tween the level of compensatory services and performance measures 
from these limited examinations. The variations both in services 
provided among grade units and in achievement measures among grade 
units suggest that it will be necessary to seek resource-performance 
relationships at the grade level. If analyses are carried out on a 
more aggregate level, such as for the school as a whole, possible 
sources of differences in the relationship between compensatory re- 
sources and eiCihanced achievement may be hidden. 



SECTION 5 

BASIC DATA ON FOUR DISTRICTS 



I 



This section contains a copy of printouts of the basic data for 
Districts 10, 12, 13, and 14 (Table 7). There is a total of 72 grade- 
unit observations in 27 schools. These data, which are interpreted 
in Figure 6, are available on cards and on tape. 

Longitudinal data used in the analysis of District 8 are not shown. 
These are available from TEMPO working notes. Data on the other 
seven districts iiicluded in Phase I are presented in Appendix I of 
Reference 43. 
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